logo logo International Journal of Educational Methodology

IJEM is a leading, peer-reviewed, open access, research journal that provides an online forum for studies in education, by and for scholars and practitioners, worldwide.

Subscribe to

Receive Email Alerts

for special events, calls for papers, and professional development opportunities.

Subscribe

Publisher (HQ)

RHAPSODE LTD
Eurasian Society of Educational Research
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, UK. HA4 7AE
RHAPSODE LTD
Headquarters
College House, 2nd Floor 17 King Edwards Road, Ruislip, London, UK. HA4 7AE

'item analysis' Search Results



...

Three methodological approaches were applied to understand the role of interest and self-efficacy in reading and/or writing in students without and with persisting specific learning disabilities (SLDs) in literacy. For each approach students in grades 4 to 9 completed a survey in which they rated 10 reading items and 10 writing items on a Scale 1 to 5; all items were the same but domain varied. The first approach applied Principal Component Analysis with Varimax Rotation to a sample that varied in specific kinds of literacy achievement. The second approach applied bidirectional multiple regressions in a sample of students with diagnosed SLDs-WL to (a) predict literacy achievement from ratings on interest and self-efficacy survey items; and (b) predict ratings on interest and self-efficacy survey items from literacy achievement. The third approach correlated ratings on the surveys with BOLD activation on an fMRI word reading/spelling task in a brain region associated with approach/avoidance and affect in a sample with diagnosed SLDs-WL. The first approach identified two components for the reading items (each correlated differently with reading skills) and two components for the writing items (each correlated differently with writing skills), but the components were not the same for both domains. Multiple regressions supported predicting interest and self-efficacy ratings from current reading achievement, rather than predicting reading achievement from interest and self-efficacy ratings, but also bidirectional relationships between interest or self-efficacy in writing and writing achievement.  The third approach found negative correlations with amygdala connectivity for 2 reading items, but 5 positive and 2 negative correlations with amygdala connectivity for writing items; negative correlations may reflect avoidance and positive correlations approach. Collectively results show the relevance and domain-specificity of interest and self-efficacy in reading and writing for students with persisting SLDs in literacy.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.3.1.41
Pages: 41 - 64
cloud_download 1493
visibility 2470
8
Article Metrics
Views
1493
Download
2470
Citations
Crossref
8

Scopus

...

Energy literacy is a minimum required capacity for developing a sustainable society that participates in and discusses on energy and environmental (EE) issues. Understanding the energy literacy structure is of significant importance for providing effective energy education to promote people’s awareness of EE issues. In this article, an energy literacy structural model integrated with the Theory of Planned Behavior and Value-Belief-Norm Theory was investigated for 1070 lower secondary students (ages 13-15) in Japan. Structural equation modeling uncovered that the awareness of consequences is the most powerful predictor for the causality between basic energy knowledge and energy-saving behavior through the attitude toward the energy-saving behavior. A conditional process analysis elucidated that (1) the conditional effect of basic energy knowledge on the awareness of consequences depends on scientific literacy, critical thinking ability, and environmental worldview, and (2) the conditional direct and indirect effects in the mediation model of awareness of consequences on the attitude toward energy-saving behavior through the ascription of responsibility depend on environmental worldview or values and family discussion of energy-related issues. The energy literacy model proposed provides a theoretical contribution to the development of an effective energy education program.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.4.3.161
Pages: 161-186
cloud_download 913
visibility 1159
6
Article Metrics
Views
913
Download
1159
Citations
Crossref
6

Scopus

...

The first step towards discussing a phenomenon or a concept in depth and with powerful scientific principles and methodology is to develop, adapt and utilize tools that accurately measure and discover the problem. For this purpose, the present study concentrated on paternalistic leadership, which is a new concept in the field of management, and reliability and validity studies on the scale (PLS) that was used to assess paternalistic leadership by Cheng et al. (2004) were conducted to add the scale to the national literature. The study was conducted on the data collected from 326 (EFA) + 255 (CFA) research assistants to determine the validity of the scale. In a determination of the reliability of the scale, item-total point correlations and Cronbach’s Alpha internal consistency coefficient were used. In order to determine how the scale works in different cultural and qualitative samples, the adaptation version was discussed by comparing with the previous factor analysis studies of the PLS. The analysis showed that adaptation version of the PLS, with the structure of its 3 sub-dimensional and 23-items, will able to be used in studies aiming to determine the characteristics of paternalistic leadership in the organizational structure and management processes of universities for the researchers working in the field of higher education.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.4.4.267
Pages: 267-285
cloud_download 455
visibility 930
2
Article Metrics
Views
455
Download
930
Citations
Crossref
2

Scopus

...

Child maltreatment is a serious problem, worldwide. Children and young people who have experienced maltreatment face multiple physical and mental health challenges which hinder their success at school and these adverse experiences makes them more challenging to teach than their non-maltreated peers. Increasingly, teachers are considered as an important part of the wider the child protection workforce as they are well-placed to intervene and prevent further harm. To fulfil this role effectively, teachers require requisite training beginning in initial teacher education programs. This paper is a protocol for a systematic scoping review that asks: “What is known about preservice/initial teacher education for child protection?”  Systematic scoping reviews are worthwhile and necessary in fields where research is diverse and needing of synthesis to identify strengths in the body of evidence and identify gaps to set new research directions. We will draw on Askey and O’Malley’s six-stage scoping review methodology to assess the scope, range, and nature of research activity on this topic. We will add an innovative seventh stage involving a commitment to disseminating and applying knowledge generated from the review. The research question has been established, and key terms defined (Stage 1). The search strategy has been devised, and searches have been run (Stage 2). Round 1 screening of titles and abstracts is completed and full text screening is currently in progress (Stage 3). To our knowledge this is the first attempt to systematically map the empirical literature on child protection in pre-service teacher education. When completed, this systematic scoping review will offer a comprehensive, transparent, and replicable way to assess the full scope of empirical research on this important topic of utmost educational relevance.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.5.1.19
Pages: 19-34
cloud_download 750
visibility 1070
6
Article Metrics
Views
750
Download
1070
Citations
Crossref
6

Scopus

...

This research was conducted to investigate the predictive role of homophobia and unconditional self-acceptance on respect of differences in psychological counselor candidates. Participants were 239 psychological counselor candidates. The Respect of Differences Scale, the Homophobia Scale, and the Unconditional Self-Acceptance Scale were used to collect the data. Path analysis was used to determine the influences of variables on respect of differences. The independent sample t-test and one-way ANOVA were used to determine differences between participants in terms of gender and grade. The results of the analysis indicated that homophobia and unconditional self-acceptance are predictors of respect of differences, and place of living and traditionally have an indirect effect on respect of differences. In addition, female participants reported a higher level of respect of differences than male participants. Similarly, first year college students reported a higher level of respect of differences than fourth year college students.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.5.1.59
Pages: 59-70
cloud_download 489
visibility 867
2
Article Metrics
Views
489
Download
867
Citations
Crossref
2

Scopus

...

Understanding the structure of energy literacy is of importance to provide an effective energy education. This article reports the difference in attributes of energy literacy by applying the energy literacy structural model proposed in our previous study through lower secondary school students in Thailand (N = 635) and Japan (N = 1070). Results indicated that Thai students scored higher than those of Japan except the basic energy knowledge and awareness of consequences. On the other hand, the amount of basic energy knowledge did not affect to increase the entire energy literacy of Japanese students. Moreover, mean values of Japan tended to decrease with the school year progression. The energy literacy model was able to support our previous outcome that the awareness of consequences plays a critical role to link between basic energy knowledge and energy-saving behavior. The social expectations or pressures may affect the structure of energy literacy of Thai students. This study suggested that the energy education required in Thailand is to enable students to derive solutions by their own critical thinking based on knowledge relevant to the energy and environmental issues. While, for Japan, it may be necessary to implement energy education as early as possible to enhance students’ awareness of consequences in an appropriate manner incorporating with family participation and visiting energy-related facility. These findings contribute the development of energy education for improving energy literacy in an effective manner.  

description Abstract
visibility View cloud_download PDF
10.12973/ijem.5.2.183
Pages: 183-201
cloud_download 438
visibility 915
2
Article Metrics
Views
438
Download
915
Citations
Crossref
2

Scopus

...

The aim of this study is to compare 2018 Science Course Curriculum (SCC), 2015 Trends in International Mathematics and Science Study (TIMSS) and 2018 High School Entrance Examination (HSE) in terms of content domains, cognitive domains and learning objectives. Qualitative research method, was used in this study. Data were analyzed using document review matrices to determine the similarities and differences between the objectives of SCC, TIMSS and HSE. SCC outcomes and HSE science questions were also classified according to TIMSS cognitive domains. Results show that the learning objectives of the fields of Physics, Biology and Earth Sciences of TIMSS are compatible with those of all grade levels of SCC and that the objectives of Chemistry are compatible with those of the seventh and eighth grades. Most of HSE questions are compatible with the objectives of SCC, however, the latest revision in the curriculum has introduced some eighth grade objectives to other grade levels. HSE science questions measure higher-level skills than TIMSS science questions. The subject domain of the “Organisms and Life” of SCC has the most learning objectives in the levels of “knowing” and “reasoning” while the subject domain of the “Physical Events” has the most learning objectives in the levels of “applying.” Besides, the seventh-, fifth- and eighth-graders have the most objectives in the levels of “knowing,” “applying,” and “reasoning,” respectively. It is hoped that the results will contribute the literature in improvement of science curricula and interpretation of national and international exams.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.5.3.433
Pages: 433-449
cloud_download 843
visibility 1091
2
Article Metrics
Views
843
Download
1091
Citations
Crossref
2

Scopus

...

Teacher-made tests (TMT) are the most used instruments for assessment and evaluation. This study investigates the cognitive requirements, test construction errors, and item types of TMTs. Content analysis technique is used in order to analyze and classify TMT items based on TIMSS-2019 assessment framework and based on criteria that is constructed to determine test construction errors. The data is consisted of 548 items in 30 exam papers of 18 mathematics teachers from 13 distinct schools. The distribution of TIMSS-2019 cognitive demands of all TMTs indicates that there is a strong emphasis on knowing or applying cognitive domains, with a total percentage of 93. Since 83% of all questions are of multiple choice and 17% are constructed-response type, teachers mostly prefer multiple choice item type. Findings also reveal that except face validity, there are errors concerning test constructions. Consequently, it is suggested that teachers should give more care on preparing items of higher cognitive levels, on tests of mixed type items, and on tests that involve lesser construction errors for more reliable tests. Finally, it is also suggested that measurement and evaluation specialists should be employed in each school or in each local Ministry of National Education Authority at least, in order to support teachers, but if this is not possible in a close time, there must be in-service training programs on measurement and evaluation for teachers to participate in.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.5.3.479
Pages: 479-488
cloud_download 341
visibility 687
3
Article Metrics
Views
341
Download
687
Citations
Crossref
3

Scopus

...

This study describes the development and validation of a psychometrically-sound instrument, the Active Learning Strategies Inventory (ALSI), designed to measure learners’ perceptions of their active learning strategies within an active learning context. Active learning encompasses a broad range of pedagogical practices and instructional methods that connect with an individual learner's active learning strategies. In order to fulfill the study's goals, a conceptual framework on learners’ active learning strategies was developed and proposed, drawing upon the research literature on active learning. The development and construct validation of the Active Learning Strategies Inventory (ALSI), based on the conceptual and methodological underpinnings, involved identifying five scales of learners’ active learning strategies: engagement, cognitive processing, orientation to learning, readiness to learn and motivational orientation. An item pool of 20 items was generated following an extensive review of the literature, standardized card sorting procedures including confirmatory factor analysis and scale validation of a pilot (n = 407) survey. The ALSI scale demonstrated strong internal consistency and reliability with a Cronbach's alpha ranging from 0.81 to 0.87. High item loading scores from the factor analysis provided initial support for the instrument's construct validity of the five-factor model. The ALSI scale provides a reliable and valid method for researchers and academicians who wish to measure learners' perceptions of their active learning strategies within an active learning context. Finally, we discuss the implications and address the limitations and directions for future research.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.1.201
Pages: 201-223
cloud_download 993
visibility 1148
5
Article Metrics
Views
993
Download
1148
Citations
Crossref
5

Scopus
4

...

The purpose of this study is to examine the mediator role of cognitive flexibility and difficulties in emotion regulation in the relationship between resilience and distress tolerance amongst college students. The sample of the study involved 1114 students (771 females, 343 males) from various universities in Turkey. The mean age of the sample was 20.65 (Sd=2.77). The Resilience Scale, Distress Tolerance Scale, Cognitive Flexibility Scale, and Difficulties in Emotion Regulation Scale (DERS) had been used to collect data. In this study, a Serial Multiple Mediation Model was used, as proposed by Hayes. The findings showed that people with a higher level of distress tolerance possess higher degrees of cognitive flexibility and that cognitively more flexible individuals experience less difficulty in emotion regulation, and thus, lower levels of difficulty in emotion regulation were associated with an increase in resilience. Furthermore, the model in its entirety had proven to be statistically significant, accounting for 42% of the total variance.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.5.4.525
Pages: 525-533
cloud_download 3570
visibility 3945
41
Article Metrics
Views
3570
Download
3945
Citations
Crossref
41

Scopus
33

...

“Mathematical knowledge for teaching” is a concept indicating the requirement for a specific kind of knowledge required to teach mathematics. Mathematical knowledge for teaching necessitates a more complex structure than what is required to carry out mathematical tasks and the knowledge to do that. The purpose of this study is to realize the adaptation of “Mathematical Knowledge for Teaching -Geometry (MKT-G)” Test that was initially conceived in English to Turkish (or to Turkish culture). During the adaptation process; after the translations of the items, focus group interviews were held with a group consisting of mathematics teacher educators and experienced mathematics teachers, and then the data from 243 elementary mathematics teachers was analyzed via  Item Response Theory (IRT). As a result of the analysis of the test items, psychometric values of the test items indicated that the items in the test performed well in Turkey. Besides, validity and reliability arguments were also tested. As a result, the Turkish version of the MKT-G test is highly reliable and valid to measure the teachers’ knowledge of teaching geometry.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.5.4.547
Pages: 547-565
cloud_download 493
visibility 822
4
Article Metrics
Views
493
Download
822
Citations
Crossref
4

Scopus
3

...

This research aims to explore the effectiveness of interdisciplinary education program based on multicultural education on the tolerance value, attitude and critical thinking skills of the fourth grade primary school students. Single group pre-posttest design has been used in the study. The research has been carried out with 30 fourth-grade students, at a primary school located within the district of Karakocan in Elazig during the 2015-2016 academic year. Among the participants, 15 are females and 15 are males. The research has employed Tolerance Attitude Scale developed by Kaptan-Yarar, tolerance value and critical thinking story tests and scoring rubrics. Descriptive statistics and dependent samples t-test have been used during data analysis. Research results have revealed a statistically significant difference between critical thinking scoring rubric, tolerance value scoring rubric and tolerance attitude scale pretest-posttest scores in favor of posttest. Based on these results, it can be said that the interdisciplinary curriculum developed based on multicultural education improves students' critical thinking skills, tolerance value and attitudes.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.6.1.43
Pages: 43-55
cloud_download 1529
visibility 1580
21
Article Metrics
Views
1529
Download
1580
Citations
Crossref
21

Scopus

...

STEM education is a pedagogical philosophy which aims to draw the interrelationship between science, technology, engineering and mathematics to solve complex problems in real life situations. In order to use STEM education to foster students’ learning, the researchers designed STEM activities for middle school students related to the concept of force and motion in three different approaches: a linear model, a jigsaw learning and a stand-alone engineering design activity. To compare the effectiveness of the three approaches, the researchers analysed students’ reasoning and problem-solving scores gained before and after doing the activities. The result showed students participating in the linear model and in the jigsaw learning significantly outperformed those in the stand-alone engineering design activity. In addition, when comparing conceptual development between those attending the linear model and jigsaw learning, the result showed that the former significantly outperformed the latter. It is therefore suggested that to maximise the effectiveness of STEM activities in promoting conceptual understanding as well as reasoning and problem-solving skills, teachers should adopt the linear model. However, when instructional time is limited, the jigsaw learning can be considered as an alternative approach. The stand-alone engineering design activity although can promote students’ enthusiasm to learn, it may not sufficiently lead to the development of reasoning and problem-solving skills as expected.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.6.1.185
Pages: 185-198
cloud_download 1456
visibility 2262
13
Article Metrics
Views
1456
Download
2262
Citations
Crossref
13

Scopus

...

Pearson product–moment correlation coefficient between item g and test score X, known as item–test or item–total correlation (Rit), and item–rest correlation (Rir) are two of the most used classical estimators for item discrimination power (IDP). Both Rit and Rir underestimate IDP caused by the mismatch of the scales of the item and the score. Underestimation of IDP may be drastic when the difficulty level of the item is extreme. Based on a simulation, in a binary dataset, a good alternative for Rit and Rir could be the Somers’ D: it reaches the ultimate values +1 and –1, it underestimates IDP remarkably less than Rit and Rir, and, being a robust statistic, it is more stable against the changes in the data structure. Somers’ D has, however, one major disadvantage in a polytomous case: it tends to underestimate the magnitude of the association of item and score more than Rit does when the item scale has four categories or more.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.6.1.207
Pages: 207‒221
cloud_download 1088
visibility 1294
16
Article Metrics
Views
1088
Download
1294
Citations
Crossref
16

Scopus

...

Kelley’s Discrimination Index (DI) is a simple and robust, classical non-parametric short-cut to estimate the item discrimination power (IDP) in the practical educational settings. Unlike item–total correlation, DI can reach the ultimate values of +1 and ‒1, and it is stable against the outliers. Because of the computational easiness, DI is specifically suitable for the rough estimation where the sophisticated tools for item analysis such as IRT modelling are not available as is usual, for example, in the classroom testing. Unlike most of the other traditional indices for IDP, DI uses only the extreme cases of the ordered dataset in the estimation. One deficiency of DI is that it suits only for dichotomous datasets. This article generalizes DI to allow polytomous dataset and flexible cut-offs for selecting the extreme cases. A new algorithm based on the concept of the characteristic vector of the item is introduced to compute the generalized DI (GDI). A new visual method for item analysis, the cut-off curve, is introduced based on the procedure called exhaustive splitting.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.6.2.237
Pages: 237 - 258
cloud_download 827
visibility 998
6
Article Metrics
Views
827
Download
998
Citations
Crossref
6

Scopus

...

A new index of item discrimination power (IDP), dimension-corrected Somers’ D (D2) is proposed. Somers’ D is one of the superior alternatives for item–total- (Rit) and item–rest correlation (Rir) in reflecting the real IDP with items with scales 0/1 and 0/1/2, that is, up to three categories. D also reaches the extreme value +1 and ‒1 correctly while Rit and Rir cannot reach the ultimate values in the real-life testing settings. However, when the item has four categories or more, Somers’ D underestimates IDP more than Pearson correlation. A simple correction to Somers’ D in the polytomous case seems to lead to be effective in item analysis settings.  In the simulation with real-life items, D2 showed very few cases of obvious underestimation and practically no cases of obvious overestimation. With certain restrictions discussed in the article, D2 seems to be a good alternative for these classic estimators not only with dichotomous items but also with the polytomous ones. In general, the magnitudes of the estimates by D2 are higher than those by Rit, Rir, and polychoric correlation and they seem to be close of those of bi- and polyserial correlation coefficients without out-of-range values.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.6.2.297
Pages: 297-317
cloud_download 361
visibility 806
8
Article Metrics
Views
361
Download
806
Citations
Crossref
8

Scopus

...

This study aimed to investigate whether Thai high school students’ perceived teacher support could enhance their reading ability through self-efficacy and sense of school belonging. The theoretical foundation of this study included the theory of social-motivational processes and social cognitive theory. Structural equation modeling was used for analysis and validation. The student questionnaire from the Programme for International Student Assessment (PISA) 2018 survey questions regarding teacher support, sense of school belonging, self-efficacy, and reading ability. The sample consisted of the data collected from the Thai students in the PISA2018 survey, with an effective sample size totaling 7968. The research results of the overall model showed that the perceived teacher support of Thai high school students’ had no direct effect on their reading ability, but their perceived teacher support had an indirect effect on reading ability through their self-efficacy and sense of school belonging. From the results can be seen that high school teachers in Thailand, in supporting and encouraging their students in learning, must simultaneously develop their perceived self-efficacy and sense of school belonging. Only thus can there be obvious help to their students’ reading ability.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.6.2.435
Pages: 435-446
cloud_download 638
visibility 923
10
Article Metrics
Views
638
Download
923
Citations
Crossref
10

Scopus

...

Humans have had to immigrate from one country to another throughout the history because of economic problems, warfare, safety, etc. Warfare and migration definitely bring about traumatic incidents for all humanity. However, they are much more destructive for children. The current study aims to review the warfare-and-migration-themed drawings of the Syrian and Palestinian children living in Turkey as refugees in comparison to the Turkish children’s drawings. A case study design was employed as a qualitative methodology. 19 Syrian, 6 Palestinian and 25 Turkish children aged between 6-10 years studying in various primary schools in City of Istanbul made up the study sample. Children were asked to draw pictures of warfare and migration, observed and interviewed for data collection. Content analysis was used to determine the themes present in the qualitative data. The themes identified in the drawings were discussed referring to the literature and recommendations were made.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.6.2.481
Pages: 481-495
cloud_download 806
visibility 1121
8
Article Metrics
Views
806
Download
1121
Citations
Crossref
8

Scopus

...

Progress monitoring of academic achievement is an essential element to prevent learning disorders. A prominent approach is curriculum-based measurement (CBM). Various studies have documented positive effects of CBM on students’ achievement. Nevertheless, the use of CBM is associated with additional work for teachers. The use of tablets may be of help here. Yet, although many advantages of computer- or tablet-based assessments are being discussed in the literature (e. g. innovative item formats, adaptive testing, automated scoring and feedback), there are still concerns regarding the comparability of different assessment modes (paper-pencil vs. tablet). In the study presented, we analyze the CBM data of 98 fourth graders. They processed the exact same computation items once with paper and pen and once in a tablet application. The analyses point to comparable results in the test modes, although some significant deviations can be found at item level. In addition, the children report perceived benefits when working with the tablet.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.6.4.669
Pages: 669-680
cloud_download 1023
visibility 1118
13
Article Metrics
Views
1023
Download
1118
Citations
Crossref
13

Scopus

...

Speaking is considered as a challenging skill to improve as it is a productive one which requires the learners to be unique and creative in the way they express themselves. Therefore, teaching speaking takes the attention of the researchers in the field of English language teaching. Therefore, the way “speaking” was integrated into the curriculum of a School of Foreign Languages in one of the state universities in Istanbul was investigated by the researcher to find out whether the speaking component of the program helped students improve their oral language proficiency and to learn both efficiency and sufficiency of it from the perspectives of the students as well as the instructors in that institution. For this purpose, eight students within the program were taken into five different speaking tests in five different weeks sequentially and were interviewed by the researcher afterwards. Additionally, six students who had taken this program of the school previously and were taking their departmental courses at the time of the study were also interviewed to give them the chance to reflect back on their past experiences as learners who applied the knowledge they had acquired from this school. Six different instructors working in this institution were also interviewed. One of them was also observed in her real class environment. Results showed that the program was found “efficient” in some aspects such as the importance given to “speaking” but there were some points that needed consolidation just like the materials.

description Abstract
visibility View cloud_download PDF
10.12973/ijem.7.1.33
Pages: 33-51
cloud_download 1314
visibility 1219
5
Article Metrics
Views
1314
Download
1219
Citations
Crossref
5

Scopus

...